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Description 

Background of the Invention 

This invention relates to video signal processing, and more particularly to an improved system for transforming a 
video image in one two-dimensional plane into another two-dimensional plane according to an arbitrary mapping func- 

In the field of live video special effects, it is desirable to be able to map one image into another with as much 
flexibility as possible. Observation of modem television gives an indication of many uses of video special effects 
including spatial transformations such as rotations, tear-away images, folding and unfolding images, images movinq 
at different angles to the plane of the actual picture, etc. 

In a digital video production facility, a field of video, whether in composite or component form, is processed as a 
series of luminance, chrominance, keying and (possibly) depth values at sequential pixel locations. A field or frame of 
such video is transmitted one line of pixels at a time, starting at the top left of the field and moving across one line 
then the next, etc. The resulting digital signal can thus be thought of as a two<jimensional real-valued function sampled 
on a rectangular grid. 

It would be desirable to be able to receive a stream of data representing such a video image and map it from a 
source coordinate system (h,v) into a destination coordinate system (x,y). For simple linear mappings this is a trivial 
problem. However, for a mapping that is non-linear or many-to-one and therefore able to map an image even if the 
resulting image is distorted and folded over in a complicated way, a fast and effective transformation mechanism is 
much more difficult to attain. 

An example of such a mapping system is described in U. S. Patents 4,563,703, 4,709,393 and 4,757,384, all 
assigned to Quantel Limited. One aspect of this video signal processing system is the way it produces mapped ad- 
dresses. As described in the '393 patent at column 5, line 29, to column 6, line 24, mapping shapes are generated by 
25 a computer and stored in a disc store. Because access to the disc store is slow relative to video speeds, address 
interpolation is used both spatially and temporally. (Temporal interpolation is interpolation between two video frames 
separated in time by other video frames.) Despite the inventor's statement that: "We have found that this technique 
does not produce any noticeable degradation to the picture produced.*, certain types of pictures are adversely affected 
by these interpolation techniques. 
30 Another aspect of the video signal processing system disclosed in the '393 patent is shown in FIGS. 3 and 4 of 

that patent and described in the text at column 3, line 6, to column 4, line 43. Four channels of multipliers, summers 
and framestores process an incoming picture point into a bank of four adjacent pixels in the output video frame, using 
a series of read-process-write operations. The contents of the same pixel in the four separate framestores are summed 
together at readout time. It would be desirable to be able to accumulate data for four adjacent output pixels without 
35 employing four complete framestore memories. 

What is desired is a new approach to video image processing that more efficiently utilizes memory resources and 
which operates fast enough to process a video image stream without introducing artifacts through temporal and spatial 
interpolation. 

40 Summary of the Invention 

According to one aspect of this invention there is provided a method as claimed in claim 1 herein. 
According to another aspect of this invention there is provided a system as claimed in claim 10 herein. 
The video mapping system according to the present invention includes a weighting coefficients generator and a 
45 two-dimensional resampling filter that efficiently utilize memory resources and operate fast enough to process a video 
image stream without introducing artifacts through temporal and spatial interpolation. This system can accommodate 
non-linear and many-to-one mappings, allowing a source two-dimensional video image to be folded over itself in com- 
plicated ways to produce an image in the target coordinate system. The only restrictions on the mapping are that it be 
piecewise continuous and single-valued. 

In said one aspect of the invention, a method is provided for determining the area of a quadrilateral having vertices 
A, 8, C and D that is in each of an array of regions. This method may include the steps of: (a) translating coordinates 
to place an origin O at the center of the array of regions; (b) determining which of a plurality of geometric cases pertains 
from how the lines A-B, B-D, D-C and C-A forming the perimeter of the quadrilateral intersect an x axis and a y axis 
passing through the origin; (c) switching coordinate data to appropriate inputs of ratio ascertaining circuitry based on 
the determined case; (d) ascertaining secondary triangle ratios from the switched coordinate data- (e) calculating pri- 
mary triangle areas ABO, BDO, DCO and CAO; (f) multiplying the primary triangle areas by the'secondary triangle 
ratios according to the determined case to obtain secondary triangle areas; and (g) combining primary triangle areas 
with secondary triangle areas according to the determined case to obtain the proportion of the quadrilateral that is 
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within each of the plurality of regions to generate respective weighting coefficients for each of those regions 

In said another aspect of the invention, an incoming stream of pixels from a source video image is mapped into a 
destination coordinate system and then filtered by resampling to produce output video fields. The contributions of every 
portion of every incoming pixel that impinges on a particular destination pixel are accumulated to produce values of 

s luminance, chrominance components, keying and depth for the destination pixel. A two-dimensional resampling filter 
includes a multiplier for multiplying video data by a weighting coefficient to produce a weighted video data element a 
comparator for identifying when an incoming pixel is in the same output pixel, an accumulator for accumulating weighted 
video data elements associated with the same output pixel into a running total, and circuitry for determining when there 
is no additional data associated with that pixel and outputting the accumulated running total Multiple layers mapped 

io to the same destination space are combined according to depth, degree of transparency or other factors Anti-aliasina 
filtering is implicit in the approach. y 
The subject matter of the present invention is particularly pointed out and distinctly claimed in the concluding 
portion of this specification. However, both the organisation and method of operation, together with further advantages 

rs drawing ,hereof ' may best be unde ^tood by reference to the following detailed description and accompanying 

Brief Description of the Drawings 

FIG. 1 is an illustration of how rectangles in a source coordinate system are mapped into quadrilaterals in a des- 
20 tination coordinate system; 

FIG. 2 is an illustration of how a number of quadrilaterals from the source coordinate system can contribute to the 
value of one destination coordinate system pixel; 

FIGS. 3A-3D illustrate how one quadrilateral from the source coordinate system may map into four different pixels 
in the destination coordinate system; 



25 



FIG. 4 is an overview block diagram of the image transforming system of the present invention; 
FIG. 5 is an illustration of how a mapped quadrilateral is analyzed by the weight generator; 
FIG. 6A is an illustration of how folding of the input image appears in the output image; 

FIG. 6B is an illustration of how a double fold of the mapped input image can produce three layers in an output pixel- 
FIG. 7 is an illustration of the twelve basic geometric cases of how a quadrilateral may impinge on four quadrants ' 
30 FIGS. 8A and SB are a block diagram of the weighting coefficients generator ; 

FIGS. 9A and 9B are a block diagram of one bank of the two-dimensional resampling filter shown in FIG 4 
FIG. 10 is an illustration of how one bank of the two-dimensional resampling filter receives the mapped quadrilat- 
erals of the source video; 

FIG. 11 is a block diagram of a first version of the field memory that only keeps track of front and back sides- and 
FIG. 12 is a block diagram of a second version of the field memory that keeps track of top and bottom layers of 
video using depth information, including the use of keying information to mix bottom layers. 
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Detailed Description 



In the following description, a frame of video will be considered as composed of abutting rectangular pixels uniform 
in size. The point at the center of each pixel rectangle is defined as the pixel's location. These pixel locations are integer 
points on a rectangular grid. Each pixel location can be defined as an (h,v) pair in a coordinate system whose origin 
is in the upper left corner of the frame, to the left of and above pixel one of line one. Every pixel of every line can then 
be defined by integer (h,v) coordinates representing its pixel number (h) and line number (v). Pixel numbers increase 
moving to the right from the origin, while line numbers increase moving downward from the origin. 

Each pixel coordinate has associated with it a luminance value, which we will refer to as Y, chrominance values 
I or Q, and a transparency or key value, K. To simplify the following discussion, we will temporarily consider only the 
luminance values at each pixel location, bearing in mind that other values can be treated similarly We will also consider 
one continuous piece of the mapping for now. The luminance value at a particular location (h,v) in the video frame can 
so be assigned a magnitude, Y(h,v). 

Referring to FIG. 1, pixels in a source coordinate system (h,v) on the left are shown mapped into a destination 
coordinate system (x,y) on the right. The pixel (3,1) in the source coordinate system is shown highlighted by shading 
in the destination coordinate system <x,y). The mapping is applied to the coordinates of the corners of the rectangular 
pixels in the source coordinate system. Therefore, while each pixel in the source coordinate system is a rectangle (here 
shown as a square), in the destination coordinate system it normally becomes an arbitrary quadrilateral determined 
by the mapping function. The quadrilaterals mapped into the destination coordinate system directly abut one another 
in the destination coordinate system in a continuous manner. 

Referring now to FIG. 2, a mapped region of 16 source pixels is shown covering one destination pixel. The lumi- 
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nance of this destination pixel, when it is produced, will be the weighted average of the luminance values of all of those 
source pixels or portions of source pixels, according to how much of their area is within the destination pixel. Using 
the prefixes °p" for "portion" and "a" for "air, it can be seen that the following source pixels contribute to the value of 
this destination pixel: p2, p3, p5, p6, p7, pB, p9, alO, p11, pi 2, p14 t p15. 

What is now needed, and what is supplied by the system of the present invention, is a way to accumulate the 
contributions of each of the quadrilaterals mapped from the source coordinate system into the value of the destination 
coordinate system pixel with appropriate weighting. One method of calculating the appropriate weightings for use in 
this process is described below, although other approaches could be substituted. 

A restriction of this implementation on the mapping function is that no side of any pixel is allowed to be more than 
1/sqrt2 (one over the square root of two) of its former size. This guarantees that no mapped quadrilateral will ever 
impinge on more than four destination coordinate system pixels, thus limiting the amount of hardware required. Relaxing 
this size restriction requires having a weighting coefficient generator that produces more than four, e.g. nine, coeffi- 
cients, more than four banks of two-dimensional resampling filters, and a segmentation of odd/even field memories 
into more than four banks. 

Referring now to FIGS. 3A-3D, the destination coordinate system plane may be considered to consist of four types 
of pixels: those with even x and even y numbers, 00, those with odd x and even y numbers, 01 , those with even x and 
odd y numbers, 10, and those with odd x and odd y numbers, 11. With the above restriction on the maximum size of 
mapped quadrilaterals, no more than one of each of these types of destination coordinate system pixels will ever 
receive input values from one mapped quadrilateral. FIG. 3A shows a quadrilateral that impinges on a bank-set (i.e a 
group) of pixels whose upper left pixel is a 00. FIG. 3B shows a quadrilateral that impinges on a bank-set of pixels 
whose upper left pixel is a 01. FIG. 3C shows a quadrilateral that impinges on a bank-set of pixels whose upper left 
pixel is a 10. FIG. 3D shows a quadrilateral that impinges on a bank-set of pixels whose upper left pixel is a 11. 

For each quadrilateral, we wish to determine the amount of its area that impinges on each of the (x,y) pixels that 
it maps into, multiply that area by the luminance (or other) value associated with that quadrilateral, and then accumulate 
that result into a luminance (or other) value for that pixel. 

Referring now to FIG. 4, an overview block diagram is shown for a video image mapping system according to the 
present invention. Timing signals from the input video signal are applied to a mapped address generator 10 which uses 
them to sequentially generate the addresses of the corners of the pixels in the source coordinate system (h : v). For 
example, referring to FIG. 1, pixel (3,1)'s upper left corner, (2.5, 0.5), is generated first. Then, when the upper left corner 
of pixel (4,1 ) is mapped as (3.5,0.5), it also serves to define the upper right corner of pixel (3,1 ). Similarly, the mapping 
of the upper left corner of pixel (3,2) on the next line as (2.5,1.5) serves also to define the lower left corner of pixel 
(3, 1 ). Finally, the mapping of the upper left comer of pixel (4,2) also serves to define the lower right corner of pixel (3,1 ). 

The mapped address generator 10 then applies the mapping function to these addresses to produce addresses 
for the comers of the resulting quadrilateral in the destination coordinate system (x,y). A variety of mapping algorithms 
could be used, such as those described in "Curves and Surfaces for Computer Aided Geometric Design", by Gerald 
Farin, Academic Press. Inc., Harcourt-Brace-Jovanovich, 2d Ed., 1990. 

FIG. 5 shows an example of a quadrilateral defined by comers A : B, C and D in the destination coordinate system. 
The coordinates of these corners are (A^ Ay), (B^ By), (C x , C y ) and (D x ,D y ). Since the comers of the incoming rectangle 
map to non-integer locations in the output coordinate system, the addresses produced by the mapped address gen- 
erator 10 are longer than the incoming addresses. The addresses generated by the mapped address generator contain 
a pixel part that determines the output pixel within which the comer falls, and a sub-pixel part that indicates the location 
of the corner within the output pixel. Referring again to FIG. 4, the mapped address generator 10 provides the ordinate 
and abscissa components A*, Ay, B x , By, C x , C y , D x and D y (hereafter A x ...D y ) of the corners of the quadrilateral to the 
origin translation circuitry 1 2. 

The origin translation circuitry 12 finds the minimum x and minimum y values, (X.min, Y.min). The values X.min 
and Y.mtn are truncated so that their least significant bits represent two pixels horizontally and two lines vertically, and 
these pixel addresses (minus one LSB) are sent to a bank-set of four two-dimensional resampling filters 1 6. X truncated 
values are sent to banks (pixels) 01 and 11 , while truncated values plus the most significant truncated bit are sent to 
banks 00 and 10. Y truncated values are sent to banks 10 and 11, while truncated values plus the most significant 
truncated bit are sent to banks 00 and 01 . 

The least significant x and y bits of the pixel addresses specify which of the four cases shown in FIGS. 3A through 
3D has occurred. These two bits of bank-set-type information are sent to the weighting coefficients generator 14. As 
will be further described below, multiplexer control logic in the weighting coefficients generator 14 re-routes incoming 
sub-pixel addresses and the resulting coefficients generated so that the correct coefficients are applied to the four 
banks of two-dimensional resampling filters 16 for a particular type of spatial relationship between the four banks. 

The origin translation' circuitry 12 also sends the sub-pixel portion of the A^.-Dy addresses to the weighting coef- 
ficients generator 1 4. How the weighting coefficients generator 1 4 operates to produce coefficients from this information 
will be described in detail below. The weighting coefficients generator 14 produces a coefficient for each bank, 00, 01 , 
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10 and 1 1 , and sends the coefficients to the four banks of the two-dimensional resampling filter 16. 

Processing by the weighting coefficients generator 14 cannot occur until all four values (Ax, Ay), (B^B ) t (C X ,C ) 
and (D x ,D y ) have been received. Therefore, the (A^Ay) coordinate data is delayed by one pixel and one line delayuntil 
the arrival of the (D x ,D y ) coordinates. Similarly, the (B x ,B y ) coordinate data is delayed by one line delay, and the (C , 
C y ) data is delayed by one pixel delay. In the implementation adopted, the mapped address generator 10 incorporates 
these delays, producing all four comer addresses for each quadrilateral at the same time. 

The two-dimensional resampling filter 16 receives the input video information, including luminance (L), chromi- 
nance (C) and keying (K), as well as pixel addresses from the origin translation circuitry 12. The two-dimensional 
resampling filter 16 also receives Z (depth) values from the mapped address generator 10 and coefficients from the 
weighting coefficients generator 14. As wilt be described in detail below, the two-dimensional resampling fitter 16 pro- 
duces output video samples, containing L. C, K and Z information based on the input signal L. C, K and map Z, in the 
destination coordinate system (x,y) and forwards them to odd field memory 18 and even field memory 20. The two- 
dimensional resampling filter also sends address information, including which side of the video image is showing, to 
the odd and even field memories 18 and 20. 

Output video timing signals are supplied by the studio environment, but must lag the input video timing signal by 
one frame interval, plus or minus about ten lines. The variability of this timing is under operator control in setting up 
the system. These timing signals are applied to horizontal and vertical counters 22 to produce an odd/even field signal 
and output addresses. A fractional part of these output addresses is sent to interpolator circuitry 26, and an integer or 
pixel part of these output addresses is sent to odd field memory 18 and even field memory 20. 
20 Alternating fields of the output video from the two-dimensional resampling filter 1 6 are stored in the odd and even 

field memories 18 and 20 and read back out of them according to the state of the odd/even field signal from the 
horizontal and vertical counters 22. Inverter 24 causes these identical field memories 18 and 20 to store and read out 
on opposite phases of the odd/even field signal. 

The interpolator 26 receives both odd and even fields of video from all four banks on its input and integrates them 
2S into one stream of video, as well as interpolating between points in that stream of video to allow for expansion of the 
image. Recall that to allow hardware conservation in the weighting coefficients generator and the two-dimensional 
resampling filter, only compression of the incoming signal was permitted by the restriction that an input quadrilateral 
mapped into the output coordinate space was not permitted to be more than l/sqrt2 of its former size. The interpolator 
allows the overall system to operate as if that restriction were not present by permitting expansion of the output image 
30 after mapping and processing according to the present invention. 

Referring now to FIG. 5, the area of the quadrilateral in FIG. 5 is the sum of the areas of the triangles CAO, ABO 
and BDO minus the area of triangle DCO. The area of a triangle is half the modulus of the cross product of two sides 
that start at the same vertex of the triangle. For example, the area of ABO is 1/2|| vectorOA x vectorOB||. Since both 
vectors are in the xy plane, their cross product is perpendicular to that plane, parallel to the z axis, and there are no x 
35 or y components. The z component of the cross product is positive (into the page) if the angle between vectorOA and 
vectorOB measured counter-clockwise is between 0 and -180 degrees, and negative (out of the page) if it is between 
zero and +180 degrees. 

The area of the quadrilateral in FIG. 5 is - 1/2 the Z component of [vectorOA x vectorOB + vectorOB x vectorOD 
+ vectorOD x vectorOC + vectorOC x vectorOA]. Note that because the angle between OD and OC is negative in the 
order stated, the sign of that result is positive, canceling out part of the other results which were all negative. Thus, 
the above calculation indeed produced the result (ABO + BDO - CDO + CAO). 

The above calculation (without the minus sign) yields a negative result if the points ABDC occur clockwise around 
the perimeter of the quadrilateral, and a positive result if the points occur in a counterclockwise order. Referring to FIG. 
6A, since the input scan order corresponds to AB in one line and then CD on the next line s a clockwise order for ABDC 
^5 occurs when the front side of the input picture remains the front side of the output picture, and a counterclockwise 
order occurs when the back side of the input picture is mapped to the front side of the output picture. 

Referring again to FIG. 5, the portion of the quadrilateral that is within bank 00 is the sum of triangles 0[CA]xA 
and OA[AB]y, minus the area of 0[DC]x[DC]y. Point [CA]x is the point where line CA intersects the x axis, and point 
[AB]y is the point where line AB intersects the y axis. Similarly, points [DC]x and [DC]y are the points where line DC 
so intersects the x and y axes, respectively. The portion of the quadrilateral in FIG. 5 that is within bank 01 is the sum of 
triangles 0[AB]yB and OBD, minus triangle 0[DCJyD. And, the portion of the same quadrilateral that is within bank 10 
is the triangle OC[CA)x minus triangle OC[DC]x. No portion of this quadrilateral is within bank 11. 

Referring now to FIG. 7 and the following table of geometric case equations, it can be seen that for all 12 possible 
cases that can arise, some combination of primary triangle areas, such as OAB, and secondary triangle areas, such 
as 0[DC]yC, produces the desired calculation of areas within each bank or quadrant. Actually, there are 48 possible 
sub-cases, but by rotation they can all be mapped into one of the following 12 cases: 
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Quad 01 
Quad 00 
Quad 10 
Quad 11 = 

Quad 01 
Quad 00 
Quad 10 
Quad 11 = 

Quad 01 
Quad 00 
Quad 10 
Quad 11 : 

Quad 01 
Quad 00 
Quad 10 
Quad 11 = 



TABLE OF GEOMETRIC CASE EQUATIONS 
CASE 1 

: OAB + OBD + ODC + OCA 

:0 
:0 

0 

CASE 2 

: OAB + OBD + ODC - 0[DC]yC + 0[CA]yA 
: 0[DC]yC + OCA - 0[CAJyA 

:0 

0 

CASE 3 

: OAB + OBD + ODC - 0[DC]xC + 0[CA]yA 

: 0[CAJxA - 0[CA]yA 

: OCA - 0[CA]xA + 0[DCJyC 

: 0[DC]xC - 0[DC]yC 

CASE 4 

: OAB + OBD + ODC - 0[DC]yC h 
: 0[CA]xA - 0[CA]yA + 0[DC]yC . 
: OCA - 0[CA]xA + 0[DC]xC 
0 

CASE 5 



hO[CA]yA 
■ 0[DC]xC 



Quad 


01 


= OBD 


- ODC + 0[DC]yC + 0[AB]yB 


Quad 


00 


= OAB 


- 0[AB]yB + OCA - 0[DC]yC 


Quad 


10 


= 0 




Quad 


11 


= 0 


CASE 6 


Quad 


01 


= OBD 


+ ODC - 0[DC]yC + 0[AB]yB 


Quad 


00 


= OAB 


- 0[ABJyB + 0[CA]xA - OfDCJyC + 0[DC]xC 


Quad 


10 


= OCA 


- 0[CA]xA - 0[DC]xC 


Quad 


11 


= 0 





CASE 7 





Quad 01 


= OBD + ODC - 0[DC]xC + 0[AB]yB 




Quad 00 


= OAB - 0[AB]yB + 0[CA]xA 


40 


Quad 10 


= OCA - 0[CA]xA + 0[DC]yC 


Quad 11 


= 0[DC]xC - 0[DC]yC 






CASE 8 




Quad 01 


= OBD + ODC - 0(DC]xC + OfABJyB 




Quad 00 


= OAB - 0(AB]yB + 0[CA]xA 


45 


Quad 10 


= 0[CA]yA - 0[CA]xA 




Quad 11 


= OCA - 0[CA]yA + 0[DC]xC 






CASE 9 




Quad 01 


= OBD + ODC - OfDCJxC + 0[C A]xA - 


so 


Quad 00 


= OAB - 0[AB]yB + 0[CA]yA 


Quad 10 


= 0 




Quad 11 


= OCA - 0(C A]xA + 0(DC]xC 






CASE 10 




Quad 01 


= OBD + ODC - 0[DC]xC + 0(AB]yB 


55 


Quad 00 


= 0(AB]xB - 0[AB]yB 




Quad 10 


= OCA + OAB - 0[AB]xB +0[DC]yC 




Quad 11 


= 0[DC]xC - 0[DC]yC 



0[CA]yA + 0[AB]yB 
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(continued) 



5 Quad 01 

Quad 00 
Quad 10 
Quad 11 



Quad 01 
Quad 00 
Quad 10 
Quad 11 

is 

Thus, it can be seen that by adding and subtracting triangle areas the proportion of a quadrilateral that falls within 
each bank within a set of four banks can be calculated. The circuitry and methods of the present invention must then 
include a means for determining the areas of these triangles so that they may be appropriately added and subtracted 
to obtain coefficients for use in each bank of the two-dimensional resampling filter. 
20 Referring again to FIG. 5, the x coordinate of [AB]y is 0. The y coordinate of [AB]y equals Ay + (B y -Ay) * (-A X )/(B X - 

AJ S which is equal to (AyBjj- AxBy)/ (By-A^). The area of A[AB]yO is then 1/2(A x [AB]y-AJAB]x), which can be simplified 
to OAB * (AJ/fBx-AJ. 

Note that no part of the four banks is farther from the local origin than one unit along each axis. And, since and 
B x are on opposite sides of the y axis, and they therefore have opposite signs, the magnitude of the ratio (A X )/(B X -A X ) 

25 will always be less than or equal to one. The denominator can never be zero, since A^ and are on opposite sides 
of the y axis and therefore have opposite signs and cannot be equal. If Ax and B x were not on opposite sides, vectorAB 
would not intersect the y-axis. 

Reducing the problem to be solved to a simple ratio such as (AJ/fBx-AJ is highly desirable because it involves 
just two parameters, permitting economy of implementation. If each of these parameters can be adequately defined 

30 with just seven bits of information, the resulting ratio can be found from a 16384x16 lookup ROM. And, since (Ex)/(B X - 
\) = 1 - (A X )/(B X -A X ) ! only one ratio must be calculated directly, and the other can be found by taking an unsigned 
interpretation of the two's complement of that result, i.e., subtraction from one. Note in FIG. 7 that the edges of no 
quadrilateral ever intersect the axes more than four times. Thus, four ratios are the maximum that ever need to be 
calculated (for a four bank-set implementation). 

35 Referring now to FIGS. BA and 6B which is a block diagram of the weighting coefficients generator 14, the areas 

of the primary triangles ABO : BDO } DCO and CAO are calculated by multipliers 100-1 07 and summing circuits 1 08-11 1 . 
For example, \ and By are multiplied together by multiplier 100, Ay and B x are multiplied together by multiplier 101 , 
and their difference is taken by summing circuit 108 to produce the vector product that is the area of triangle ABO. 
These double areas are divided by two as they are forwarded to the circuitry downstream by a one digit right-shift in 

40 the way the outputs are connected. The outputs of summing circuits 108-111, the areas of the four primary triangles, 
are routed to multiplexers 112 and 124, and to multiplexer, add/subtract and rotation control logic 119. 

The A^Dy sub-pixel coordinate signals, which are each 7 bits wide, are supplied to multiplexer 113 and case 
determination and multiplexer control logic 114, as well as to the multipliers 100-107. The case determination and 
multiplexer control logic 114 determines from these values and the bank-set select signals (pixel address LSBs) which 

45 of the cases shown in FIG. 7 pertains. With that information the multiplexer control logic 114 is able to provide appro- 
priate mux control signals 1 to multiplexers 113 and 112. 

At multiplexer 113, the mux control signals 1 causes appropriate pairs of signals from the set A^Dy to be applied 
to read-only-memories (ROMs) 115-118. These pairs of signals are those needed to calculate the ratios, such as the 
(W( B x~\) ratio used in tne example above, that are needed to obtain the areas of the secondary triangles, such as 

so A[AB]yO from the same example. The values of the ratio pairs select addresses in ROMs 115-118 in which their ratio 
is stored. These ratios are then produced at the outputs of ROMs 115-118 and applied to the inputs of multipliers 
120-123. 

Mux control signals 1, representative of which geometric case in FIG. 7 pertains, also control multiplexer 112 so 
that the primary triangle values on their inputs are switched to appropriate outputs for combining with the ratios from 
ss ROMs 115-118 in multipliers 120-123. The multiplication of the ratios times the primary triangle values produces sec- 
ondary triangle values at the outputs of multipliers 120-123. 

Multiplexer, ado7subtract and rotation control logic 119 receives the least significant bits of the x and y truncated 
addresses, the mux control signals 1 from the case determination and multiplexer control logic 114, the sign bits of 



TABLE OF GEOMETRIC CASE EQUATIONS 
CASE 11 

= OBD + ODC -0[DC]yC + 0[AB]yB 

= 0[AB]xB - 0[AB]yB + 0[DC]yC - 0[DC)xC 

= OCA + OAB - 0[AB]xB + 0[DCJxC 

= 0 

CASE 12 

= OBD - 0[BD]xD + 0[AB]yB 
= OAB - 0[AB]yB + 0[CA]xA 
= OCA - 0[CA]xA + 0[DC)yC 
= ODC - 0[DC]yC + 0[BD]xD 
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each of the primary triangle values from summing circuits 108-111, and the sign bits of each of the secondary triangle 
values from multipliers 120-123. It uses these signals to generate appropriate mux control signals 2 and 3 and add/ 
subtract control signals. The multiplexer, add/subtract and rotation control logic 119 can be implemented as either logic 
gates or ROM lookup or other combinational logic means. 

5 Mux control signals 2 and the add/subtract control signals configure multiplexer 124 and the nodes of adder/ 

subtractor 125 to produce the appropriate set of equations from the table of geometric case equations to produce 
quadrant 00, 01, 10 and 11 signals for the case that pertains. 

Each summation circuit 1 26-134 within the adder/subtractor circuitry 125 can be directed by the add/subtract con- 
trol signals to either add its inputs, subtract one from the other or vice-versa, pass one of its inputs through unchanged 

10 or output a zero. In an alternative implementation, the summation nodes could be less flexible and capable, but more 
multiplexing would be required to switch signals to summation circuit inputs with the right sign. Two-input summation 
circuits require two clock cycles to produce their outputs. The three-input summation circuits are actually two two-input 
summation circuits in series and take four clock cycles to produce a result. All but three of the paths through the adder/ 
subtractor circuitry are then six clock cycles long, while the path from inputs A/S IN 7, A/S IN 10 and A/S IN 13 to 

15 summation circuits 132, 133 and 134, respectively, would only be four clock long if delay elements 135, 136 and 137 
were not included to add two clock cycles of delay on those paths. 

The following Table of Adder/Subtractor Inputs shows which terms are applied to which of the inputs of the adder/ 
subtractor 125. Note that some of these inputs are always the same when they are used at all. Given the capability of 
the adder/subtractor nodes 126-134 to ignore an input, these signal lines do not require multiplexing to achieve the 

20 zero state shown, but rather can be hard-wired with the signal they always produce and ignored to achieve the blanks 
shown in this table. The values in this table are unsigned, but the signs to make up the equations shown in the Table 
of Geometric Case Equations above are supplied by the add/subtract control signals. 
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Where: 

a = OAB, b = OBD, c = ODC, d = OCA, 
ax = 0[AB]xB bx = 0[BD]xD cx = 0[CA]xA dx = 0[DC]xC 
ay = 0[AB]yB by = o[BD]yD cy = 0[CA]yA dy = 0[DC]yC 

Mux control signals 3 causes multiplexer 138 to put the appropriate coefficients on the output for each of the four 
types of bank 00, 01,10 and 1 1 . To do this, the multiplexer, add/subtract and rotation control logic 119 needs to consider 
which type of bank was to be to the upper left of the translated origin and which sub-case pertained, so that it can 
direct multiplexer 138 to put the appropriate coefficients on each of its output lines. Referring again to FIG. 4, the four 
coefficients generated by the weighting coefficients generator 1 4 shown in FIGS. 8A and SB are applied to the respective 
banks of the two-dimensional resampling filter 16. 

One of the four identical banks of the filter is shown in FIGS. 9A and 9B. The four banks all receive the same data 
information and the addresses as explained above. Multiplier 200 is actually four separate multipliers, one for luminance 
data, one for chrominance data, one for keying data and one for depth data. The 46 bits of incoming data shown 
entering multiplier 200 contain 10 bits of luminance (Y) data, 10 bits of chrominance (C) data, 10 bits of keying (K) data 
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20 



and 16 bits of depth (Z) data. 

The 1 2 bits of coefficient data arriving at sign/absolute value separator 202 are separated into 1 bit of sign infor- 
mation and 11 bits of the absolute value of the coefficient. The incoming address data contains 9 bits of x and 8 bits 
of y, with the least significant bit of the pixel part of each having already been used for bank-set selection. The sign bit 
from the coefficient data is combined with this address data to distinguish between front and back sides of the image 
in the event of folding. Remember from the discussion above that the front of the image produced a negative value in 
the vector multiplication process, while the back produced a positive sign. In the discussion of the odd and even field 
memories 18 and 20, below, it will be seen that this bit is used to keep the front and back images stored in separate 
memories. 

The multiplier 200 multiplies each portion of the data, Y, C, K and Z, by the 11 bits of coefficient data and produces 
results having 21 or 27 bits, and the results are then each rounded with dithering to 1 6 bits. Effective dithering techniques 
are well known in the art, and suitable ones are discussed at pages 1 64- 1 75 of "Digital Coding of Waveforms" by Jayant 
and Noll, published by Prentice-Hall, 1 984. The resulting 64 bits of data, in four channels of 1 6 bits each, are presented 
to the summation circuitry 204 at the same time that the address emerges from delay element 219 and is presented 
to latch 220. That is, delay element 219 matches the delay through the multiplier 200 with dither round-off. 

It should be noted that latches 206, 212, 214 and 216 are all actually four sets of latches, each for one type of 
data, Y, C, K and Z. Summation circuit 204 has a zero clock delay, so on the next clock after new data appears at its 
input, the sum of that new data and the output of multiplexer 210 appears on the output of latch 206. 

The control state machine 262 (lower right of FIG. 9B) receives vertical and horizontal sync information, and pro- 
duces four output signals: LF (line flush), AV.NFL (active video, not first line), LL+1 (last line plus one) and SOL-1 (start 
of line minus one). SOL-1 becomes /SOL (not start of line) after passing through delay latch 264 and inverter 231. The 
timing of the SOL-1 and SOL signals is adjusted for the delays presented by multiplier 200 on the data path and the 
corresponding delay 21 9 on the address path. The signal LF is active high for the first three clock cycles after the end 
of each line of video, so that latches 232, 234, 236, 254, 256, 258, 212, 214 and 216 can be flushed out. LF is ORed 
with the signal "step out' by OR gate 229 to produce the signal LFS (line-flush/step) to accomplish this, as well as 
normal within-the-line behavior. AV.NFL is active during lines of video except the first line, but not during vertical or 
horizontal sync intervals. SOL-1 is active during horizontal sync intervals. 

During the horizontal sync interval, the active SOL-1 signal resets single bit latch 254 and prevents the decoder 
252 from simultaneously setting it by disabling inverted input AND gate 255. The active SOL-1 signal also sets single 
bit latches 256 and 258 through OR gates 257 and 259, respectively. As will be further explained below, these single 
bit latches 254, 256 and 258 are normally used to keep track of which data has been used during accumulations of 
data from previous lines. The active SOL-1 signal also causes a high output of OR gate 245, loading down counter 
260 with the output, if any, of FIFO 230. The active SOL-1 also resets latch 206 (on the data path). 

However, since we are initially going to examine the behavior of the two-dimensional resampling filter 16 during 
the first line of a field of video, the normal behavior of these single bit latches 254, 256 and 258, as well as the address 
latches 232, 234 and 236, the data latches 21 2, 214 and 216, and the outputs of the FIFOs 228, 230 and 208 will be 
blocked for now. This is because during the first line of a new field of video, the signal AV,NFL is inactive low disabling 
AND gate 266 on the =0 output of down counter 260 so that the normal source of "step out" signals from OR gate 268 
is not asserted. That means that no source of "step out" signals is available, since the alternative source on the input 
of OR gate 268, the flush signal, only occurs during the last line plus one. And, with no LF signal, no "step out" signals 
also means no LFS signals to clock enable the aforementioned circuitry. Note also that AND gate 217 is also disabled 
at this time by the inactive low on LL+1. With no "step out" signals available, none of the latches 232, 234, 236, 254, 
256, 258, 21 2, 21 4 or 21 6 can be clock enabled, and they thus cannot shift their contents to the right, as they normally 
do on the clocks following a "step out" signal. 

The inactive AV.NFL signal also disables AND gates 244, 246 and 248 to ensure that no spurious outputs of 
compare circuits 238, 240 or 242 produce active inputs at the inputs of the priority encoder 250. 

During the clock cycle that data is first arriving at the inputs to latches 220 and 206, SOL-1 becomes inactive low 
and SOL goes to active high. Therefore, /SOL, the not start of line signal, is low at the inputs to AND gates 223 and 
227, disabling them. The resulting low output of AND gate 223 is inverted by inverter 224 to reset up counter 226 The 
so low output of AND gate 227 write disables FIFOs 228, 230 and 208. 

On the next clock, latch 206 presents the output of the summation circuit 204 to the input of FIFO 208 and the "4" 
input of multiplexer 210. On that same clock the present address on the input of latch 220 is latched and becomes 
previous data on its output, where it is presented to the input of FIFO 228. 

For this clock cycle and the rest of this line, SOL is inactive low and /SOL goes high. The high inputs to AND gates 
223 and 227 enable them. The output of AND gate 223 is now controlled by the output of compare circuit 222, while 
the output of AND gate 227 is.controlled by the inverted output of the same circuit (via inverter 225). 

If the address at the input of latch 220 is different than the address on its output, the output of compare circuit 222 
is low, and this low is inverted by inverter amplifier 224, so that the up counter 226 is reset. The low output of AND 
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gate 223 leaves the "4" input of the priority encoder 250 inactive low. Since we are still in the first line of a new field of 
video, AND gates 244, 246 and 248 are all producing zeros as a result of the low state of AV,NFL, so that the "3* "2" 
and "1" inputs to the priority encoder 250, as well as the "4" input, are all low. Thus, the output of the priority encoder 
250 is -000* and multiplexer 210 has its "0" input (which is "0") selected. Therefore, on the next clock, the output of 
latch 206 is written into FIFO 208, and the output of the summation circuit 204, with zero added, is clocked into latch 206 
If the address at the input of latch 220 is the same as the address on its output, i.e. the present quadrilateral pixel 
address in the destination coordinate system is the same as the previous quadrilateral pixel address in the destination 
coordinate system, the output of compare circuit 222 is high, and this high is inverted by inverter amplifier 224 and 
the up counter 226 is not reset by the resulting low. The high output of the compare circuit 222 is inverted by inverter 
225, so that AND gate 227 is not satisfied. The low output of AND gate 227 is an inactive 'step in" siqnal that does not 
write enable FIFOs 228, 230 and 208. 

The high output of compare circuitry 222 also goes to priority encoder 250 through AND gate 223 so that the 
output of the priority encoder 250 is M00". The M00" output of the priority encoder 250 directs multiplexer 21 0 to select 
input "4\ which is the contents of latch 206, the previous data. The contents of latch 206 is added to the output of 
multiplier 200. Thus, when the present quadrilateral pixel address is the same as the previous quadrilateral pixel ad- 
dress, the data associated with these two addresses is accumulated by summation circuit 204. 

So long as the input pixel address remains the same, incoming data will continue to be accumulated in latch 206 
no "step in" signal is generated and no data enters the FIFOs 228, 230 and 208. However, during this time, up counter 
226 is counting the number of incoming quadrilaterals whose data is being accumulated in latch 206. 

When the address at the A input of compare circuitry 222 no longer matches the previous address on the B input 
the resulting low on the output of thB compare circuitry 222 is inverted by inverter 225 to produce an active 'step in- 
signal out of AND gate 227. The low on the output of the compare circuitry 222 produces a low output of AND gate 
223 and causes the "4" priority to go inactive at the input to the priority encoder 250, allowing it to respond to the next 
lowest priority on its inputs. 

However while the two-dimensional filter 16 is processing the first line of a new field of video. AV.NFL is inactive 
low and AND gates 244, 246 and 248 are disabled, so no priorities "3", "2" or "1 " ever occur. Consequently, whenever 
the incoming pixel address changes and comparator 222 is not satisfied, the priority from the priority encoder changes 
from "100" directly to -000". Priority '000" causes multiplexer 210 to select its "0" input, thereby placing all zeros on its 
output, so that only "0" is added to the output of multiplier 200. This is the desired behavior, since this is an initial data 
value in the new output pixel, and there is no previous line data to accumulate it with. 

An active "step in" write enables all of the FIFOs 228, 230 and 208, so that the next clock causes the output of up 
counter 226 to be stored in FIFO 230, the previous address in latch 220 to be stored in FIFO 228, and the accumulated 
data on the output of latch 206 to be stored in FIFO 208. The active "step in" signal also resets the up counter 226 on 
that same next clock. 

The content of the up counter 226 that is stored in FIFO 230 represents the number of contiguous quadrilaterals 
in a particular line of incoming quadrilaterals that impinged on the present pixel. As will be further explained below, 
during the next line of video the numbers stored in Fl FO 230 are read out and used to keep the present line synchronized 
with the preceding line. 

As the first line of incoming quadrilaterals is traversed, successive accumulations within the bank of pixels continues 
40 and partial results, including address, data and counter contents, are stored for each output pixel address After the 
end of that first line of incoming quadrilaterals, AV.NFL becomes active during each line of video but not during the 
horizontal blanking intervals between lines. While AV.NFL is active high, AND gate 266 is enabled, permitting "step 
out" signals to be initiated by the "=0" output of down counter 260. Also, while AV.NFL is active high, AND gates 244 
246 and 248 are all enabled, permitting normal operation of priority inputs to the priority encoder 250 under the control 
45 of compare circuits 238, 240 and 242. 

At the beginning of the next line of incoming quadrilaterals, SOL-1 and SOL will perform the same initialization 
functions that they did on the first line. SOL-1 resets latches 220 and 206 and single bit latch 254, as well as setting 
single bit latches 256 and 258. Also on this second line, down counter 260 continues to produce a high "=0" output 
because it has zero contents since it was loaded by the SOL-1 induced output of OR gate 245 during a time when 
so FIFO 230 was not read enabled. On the first line, the output of the down counter 260 was blocked at AND gate 266 
by the absence of an active high AV.NFL signal. On this line, however, that high output passes through enabled AND 
gate 266 and OR gate 268 to create an active high "step out" signal. 

Active high "step out" signals read enable the FIFOs 228, 230 and 208. An active "step out" signal also passes 
through OR gate 229 to produce LFS, which clock enables latches 232, 234, 236, 254, 256, 258, 212 214 and 216 
The next clock then reads out the first-in contents of the FIFOs 228, 230 and 208 from the preceding (first) line into 
latch 232, down counter 260 and latch 212, respectively. 

The down counter 260 now counts down from the number stored on the last line, representing the number of 
contiguous quadrilaterals that were summed to produce the first data accumulation at the first pixel address. When it 
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reaches zero another 'step out" signal is produced, and, on the next clock, more data is read out of the FIFOs 228, 
230 and 208 into latch 232, down counter 260 and latch 21 2 t respectively. At the same time, the previous contents of 
latches 232 and 21 2 are latched into latches 234 and 214, respectively. Thus, the addresses and data from the previous 
line are right shilted through the address latches 232, 234 and 236 and data latches 212, 214 and 216, respectively, 

s according to the position on the present line dictated by the number of clocks that have occurred on the present line, 
thereby keeping the addresses and data of the last line synchronized with the current location on the present line. 

Referring now to FIG. 10, six adjacent output pixels in the same bank are shown, with the blank areas between 
them understood to be covered by the pixels associated with other banks in the set of four. The present quadrilateral 
274 is shown within solid lines, while the rest of the quadrilaterals shown are only marked by their corners. The present 

io quadrilateral 274 is the first one on the present line of quadrilaterals to map into the present output pixel 270. The last- 
in data stored in the FIFOs 228, 230 and 208 of FIGS. 9A and 9B are from the same line of quadrilaterals as it crossed 
the preceding output pixel 272. That set of accumulated data was stored in those FIFOs when the next quadrilateral 
after 276 had a different address and therefore produced a "step in" signal. 

Referring now to FIGS. 9A and 9B as well as FIG. 10, the data from the present quadrilateral 274 should be 

15 accumulated into the same accumulation as the quadrilateral directly above the present one, quadrilateral 278 and the 
rest of the quadrilaterals in that line of quadrilaterals that fell within this output pixel. When the present address input 
is for quadrilateral 274, the address of quadrilateral 280 is on the input of latch 232, the address of quadrilateral 278 
is on the input of latch 234, and the address of quadrilateral 282 is on the input of latch 236. Thus, A equals B on the 
inputs of compare circuitry 240. Let us assume that single bit latch 256 is not set, and that therefore its /Q output is 

20 high satisfying AND gate 246. 

Under these conditions, the outputs of compare circuits 222 and 238 will be false, since the incoming address just 
changed and the address on the A input of compare circuitry 238 is different from the one that matched the present 
address on the next compare circuit 240. Accordingly, the "4" and "3" inputs to priority encoder 250 are false and the 
"2" input is true, so the encoder output is "010". An encoded priority of "010" causes multiplexer 210 to select input 

25 "2", which is connected to the input of latch e 214, as its output. Therefore, the data accumulation stored in latch 212 
and associated with the address stored in latch 232 is added to the new data at this pixel address by the accumulator 
204. Thus, data from the preceding line having the same output pixel address is accumulated with the first input quad- 
rilateral data for the same output pixel address on the present line. 

Sometimes the first occurrence of the same pixel address on the previous line will lead or lag by one accumulation 

30 location, but in that case the address match will be detected by comparator 238 or comparator 242 instead of comparator 
240. But the same result occurs by the encoding of priority "3" or priority "1 " instead of priority "2", and multiplexer 210 
selection of latch 212 or latch 216 instead of latch 214. 

The used data latches 254, 256 and 258, when they are set, prevent the re-use of the used data associated with 
them by failing to enable the corresponding AND gates 244, 246 and 248, respectively, with their /Q outputs. When 

35 data from previous lines is accumulated into the new data on the present line by an encoded "3", "2" or "1" from the 
output of the priority encoder 250, it is important to keep track of that fact so that data that has been used once is not 
reused. Therefore, the output of the priority encoder 250 is monitored by decoder 252, and its "V, "2" and "3" outputs 
are used to set single bit latches 258, 256 or 254 ; respectively, depending on which priority produced the accumulation. 
A set latch 254, 256 or 258 disables the corresponding AND gate 244, 246 or 248 that an A=B output from one of the 

40 comparators 238, 240 or 242 must pass through in order to generate a corresponding priority at the priority encoder 250. 

Like the address latches 232, 234 and 236, and the data latches 212, 214 and 216, the single bit used data flag 
latches 254, 256 and 258 are clock enabled by the LFS signal and clocked by the system clock. Thus, the used data 
flags will march along to the right through these single bit latches 254, 256 and 258 in step with the corresponding 
address and data information. 

45 When data from a preceding line of input quadrilaterals reaches latch 216 and it has not been summed into any 

accumulation on the present line, it is final data ready for output. If this data has not been used, used data latch 258 
is not set and its/Q output is high, enabling AND gate 218. When AND gate 218 is enabled, the next LFS signal passes 
through it and through OR gate 219, and is latched into latch 241 to become an "output enable" signal to the odd and 
even field memories 1 8 and 20 (FIG. 4). The address in latch 236 is also presented to the odd and even field memories 

so 18 and 20, where it is used as their address inputs. 

Latch 241 is clock enabled by LFS and reset by the output of AND gate 235. LFS is active each time data is to be 
output, as described above. AND gate 235 is only enabled by SOL-1 during the horizontal blanking interval, when the 
output of AND gate 235 is needed to reset latch 241 after LFS goes inactive and its inverted complement produced 
by inverter 233 serves to produce an active output of the AND gate 235. 

ss The initialization of the used data single bit latches 254, 256 and 258 was discussed above. Latch 254 was initialized 

to reset and latches 256 and 258 were initialized to set by the start of line minus one signal, SOL-1. Because at the 
beginning of a line there is no meaningful data in latches 212, 214 and 216 since they were flushed at the end of the 
last line, the used data latches 256 and 258 associated with these data latches are marked as used to ensure that they 
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will not be accumulated into any totals. And, since meaningful data is present at the FIFO 208 output, the used data 
latch 254 associated with latch 212 is reset. 

When the last line of quadrilaterals has been processed, all of the data in FIFO 208 is final data ready for output, 
in that there is no more data to accumulate with it. After the last line, the signal LL+1 goes active, enabling AND gate 
217. So long as there is still data in FIFO 230, indicating that there is also still data in FIFOs 228 and 208, the signal 
not empty from FIFO 230 will satisfy AND gate 217 generating a flush signal. The flush signal passes through OR gate 
26B and becomes a constant "step out" signal, which in turn produces a constant LFS signal clock enabling all of the 
latches 232 : 234, 236, 254, 256, 258, 212, 214 and 216. The "step out" signal also read enables all of the FIFOs 228, 
230 and 20B. Successive clocks then read out the contents of the FIFOs 228 and 208, and clock them through the 
latches 232, 234 and 236 on the address path and latches 212, 214 and 216 on the data path. FIFO 230 is enabled 
but not read out, since there are no further load signals from AND gate 266. 

Referring now to FIG. 11 , a first version of the odd field memory 18 shown in FIG. 4 only keeps track of the front 
and back of a single layer of video. The incoming address data from the two-dimensional resampling filter 16 includes 
9 bits of x, 8 bits of y and one bit of side information derived from the sign bit of the coefficient data. Recall from the 
discussion above that if the side bit is one (negative), the view is of the front of the picture, and if the side bit is zero 
(positive), the view is of the back of the picture. 

The odd/even field signal selects back and forth between odd field memory 18 and even field memory 20 ; such 
that when one of them is enabled for reading, the other one is disabled for reading. Inverter amplifier 310 supplies an 
inverted version of the odd/even signal to AND gates 306 and 308, enabling the write enable inputs of the front and 
back odd field memories 300 and 302 when the read enables are disabled. The side bit is "1", active high, when the 
front of the image is being processed. Thus, when the odd field memory 18 is disabled for reading by a low odd/even 
field signal and that signal is inverted by inverting amplifier 310, and the side bit is high, indicating that the front of the 
image is being processed, a high output enable signal satisfies AND gate 306 and the write enable input to front odd 
field memory 300 is enabled. Inverter amplifier 304 inverts a low side bit, indicating the back of the signal is being 
processed, into a high that enables AND gate 308. So, when the odd field memory 18 is disabled for reading by a low 
odd/even field signal and that signal is inverted by inverting amplifier 310, and the side bit is low, indicating that the 
back of the image is being processed, a high output enable signal satisfies AND gate 308 and the write enable input 
to the back odd field memory 300 is enabled. 

When the odd/even field signal goes high, enabling reading of the front and back odd field memories 300 and 302, 
the inverted version of the odd/even signal from the output of inverter amplifier 310 disables both AND gates 306 and 
308 so that no writing to either the front or back odd field memories 300 and 302 can occur. Even field memory 20 
operates the same way as odd field memory 18, except that the odd/even field signal that it receives is of the opposite 
phase and therefore the timing of reads and writes is reversed. 

Referring now to FIG. 6B, a doubly folded map produces three layers of input video, all mapped to one output pixel 
location. To adequately deal with this case a field memory more complicated than that shown in FIG. 11 is required. 

Referring now to FIG. 12, a second version of the odd field memory 18 shown in FIG. 4 keeps track of multiple 
layers of video image, figuring out which is on top and calculating mixtures of those layers that are not the top layer 
as dictated by keying values. The address associated with new data is applied first to the read addresses of both the 
top and bottom field memories 320 and 322, and then, after a suitable delay to the write addresses of those same 
memories. The read and write enable circuitry is not shown in FIG. 12, but operates very similarly to that shown in FIG. 
1 1 , except that no side signal is included and the write enable signal should be delayed as the read address is. 

The read address and enable cause the present contents of both the top and bottom field memories 320 and 322 
at that address to be read out. All of the data from the top field memory 320 is applied to the 0 input of multiplexer 338 
and the 1 input of multiplexer 344, while only the Z component is applied to the B input of comparator 328. All of the 
data from the bottom field memory 322 is applied to the 0 input of multiplexer 340, while only the Y, C and K components 
are applied to the 1 input of multiplexer 342 and only the Z component is applied to the B input of comparator 332. 

All of the arriving new data is applied to the 1 inputs of multiplexers 338 and 340, while only the Y, C and K 
components are applied to the 0 input of multiplexer 342 and only the Z component is applied to the A inputs of com- 
parators 328 and 332. The K component of the new data arriving at the left of FIG. 12 is checked to see if it is non- 
zero, where zero represents complete transparency and one represents complete opacity, by not-equal-zero checker 
326. If K equals zero, the desired outcome is to ignore it and replace the corresponding top video with itself and the 
bottom video with itself. 

If the K value is zero, the output of not-equal-zero checker 326 is low and AND gates 330 and 336 are disabled. 
The low output of AND gate 336 also disables AND gate 337. Low outputs from AND gates 330, 336 and 337 select 
the "0" inputs of multiplexers 338, 340, 342 and 344 as their outputs. The "0" input of multiplexer 338 is the data from 
the top field memory 320, and the output of multiplexer 338 goes back to the input of that same memory, thereby 
accomplishing part of the desired outcome. 

The 0 input of multiplexer 340 is the data from the bottom field memory 322 and its output goes to the 0 input of 
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multiplexer 344, which is also selected. Since the output of multiplexer 344 gets mixed with some portion of the Y, C 
and K components of the output of multiplexer 342 and then placed in the botlom field memory 322, this bottom data 
is also going back into the memory that it came from after this mixing. And, this mixing leaves the' bottom data un- 
changed, since by definition transparent video has zero values for Y, C and K. Thus; the product of multiplying these 
zeros by any value is more zeros, so the bottom video has nothing added to it. 

For any other, non-zero, value of K, AND gates 330 and 336 are enabled and how the different layers of video get 
arranged is determined by their Z values. Let us first examine the case where the new data has the largest Z value 
indicating that the new data is farthest from the viewer. In this case, the desired result is to leave the top layer data in 
the top field memory 320, and to mix the new data with the bottom layer to the extent that it is visible through it 

When the Z value of the new data is larger than the Z value of the bottom data, the outputs of both comparators 
328 and 332 are low. A low output from comparator 328 fails to satisfy AND gate 330 and its low output then selects 
the 0 input of multiplexers 338 and 344 as their, outputs. The selection of the 0 input of multiplexer 338 permits the 
data from the output of the top field memory 320 to be returned to its input. 

A low output from comparator 332 fails to satisfy AND gate 336, which then fails to satisfy AND gate 337 The low 
output of AND gate 337 selects the 0 input of multiplexer 340 as its output. The 0 input of multiplexer 340 is the data 
from the bottom field memory 322. The output of multiplexer 340 is the selected 0 input of multiplexer 344 so the 
bottom layer data will be returned to the bottom field memory after mixing with output of multiplexer 342 

The low output of AND gate 336 selects the 0 input of multiplexer 342 as its output. The 0 input to multiplexer 342 
is the new data, as was the desired outcome. The Y, C and K components of th e new data are multiplied by the quantity 
'^bottom generated by summing circuit 346 at multiplier 348. The results are summed with the corresponding Y, C and 
K components from multiplexer 344 by summing circuit 350. The output of summing circuit 350 is the input to the 
bottom field memory 322. 

The general form of the formula by which two video signals are mixed together based on the K value of the toD 
layer is: K 



Result = Top + (1-K ( )*Bottom 

for K=0 describing completely transparent and K=1 describing completely opaque. This is the formula implemented 
by summation circuits 346 and 350 and multiplier 348. 

Let us next examine the case where the Z value of the new data is intermediate between the Z value of the top 
data and the Z value of the bottom data. In this case, the desired outcome is to leave the top data in the top field 
memory 320, but store the new data as bottom data with the old bottom data showing through by an amount determined 
by the K value of the new data. 

When the Z value of the new data is less than the Z value of the bottom data, the output of comparator 332 is high 
satisfying AND gate 336. A high output from AND gate 336 enables AND gate 337 and selects the 1 input of multiplexer 
342 as its output. Since the Z value of the new data is greater than the Z value of the top data, the output of comparator 
328 is low. The low output of comparator 328 fails to enable AND gate 330, and its low output consequently selects 
the 0 inputs of multiplexers 338 and 344 as their outputs. Multiplexer 338 will then return the top data to the top field 
memory 320, as desired. 

The low output of comparator 328 is also inverted by inverter amplifier 334, satisfying the AND gate 337 The high 
output of AND gate 337 selects the 1 input of multiplexer 340 as the multiplexer's output. The 1 input of multiplexer 
340 is the new data, so it is the new data which is on the selected 0 input of multiplexer 344. Thus, the new data with 
some of the bottom data mixed in according to the K value of the new data, will become the new bottom data, as desired 

Finally, let us examine the case where the new data has a smaller Z value than the top data. The desired outcome 
in this case is that the new data replaces the top data in the top field memory 320, and the top data, with some portion 
of the bottom data showing through according to the K value of the old top data, replaces the bottom data 

When the Z value of the new data is less than the Z values of the top data, both comparators 328 and 332 will 
have highoutputs.The high output of comparator 328 satisfies AND gate 330, whose high output then selects the 1 
input of multiplexers 338 and 344 as their outputs. The 1 input of multiplexer 338 is the new data, so it will replace the 
top data in the top field memory 320, as desired. 

The high output of comparator 332 satisfies AND gate 336, thereby enabling AND gate 337 and selecting the 1 
input of multiplexer 342 as its output. The high output of comparator 328 is inverted by inverter amplifier 334 whose 
low output then fails to satisfy AND gate 337. The low output of AND gate 337 selects the 0 input of multiplexer 340 
as its output. The 0 input to multiplexer 340 is the bottom data, but the output of multiplexer 340 is the non-selected 
input to multiplexer 344. The selected 1 input of multiplexer 344 is the top data, which will therefore replace the bottom 
data, with some of the old bottom data from multiplexer 342 mixed in according to the K value of new bottom (old too) 
data. * K/ 
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It was stated above that the mapping was subject to the restriction that it be piecewise continuous, which is to say 
continuous locally over regions within each ot which the transfer function from input frame to output frame is continuous, 
while between such regions there may be discontinuities. The question then naturally arises: How are discontinuities 
treated? 

5 It a discontinuity causes part of the area of an output pixel not to receive any quadrilaterals, the values associated 

with that pixel will be diminished by the amounts that are missing, thereby allowing part of whatever is behind that pixel 
in depth to leak through when the layers are combined with other layers, e.g. as shown in FIG. 12. 

The restriction that no side of any pixel is allowed to be more than 1/sqrt2 (one over the square root of two) of its 
former size, guarantees that no more than four output pixels are ever impinged upon by a quadrilateral from the source 

10 coordinate system. With no more than four destination coordinate system pixels ever receiving a quadrilateral from 
the source coordinate system, the hardware of the system of the present invention has been kept simple and efficient. 
This restriction could be lifted, if so desirea, by increasing the number of coefficients generated by the weighting co- 
efficient generator, and adding more banks of two-dimensional resampling filters and odd/even field memories. 

While a preferred embodiment of the present invention has been shown and described, it will be apparent to those 

is skilled in the art that many changes and modifications may be made without departing from the invention in its broader 
aspects. The claims that follow are therefore intended to cover all such changes and modifications as fall within the 
scope of the invention. 



20 Claims 

1. A method for mapping a video image having a plurality of pixels in a first two-dimensional plane into a video image 
having a plurality of pixels in a second two-dimensional plane according to an arbitrary mapping function, each 
pixel being defined as a quadrilateral about the pixel location, the method comprising the steps of: 

25 

mapping addresses for the comers of the quadrilaterals defining the pixels of the video image in the first two- 
dimensional plane into the second two-dimensional plane to produce quadrilateral addresses; 
translating an origin for the quadrilateral addresses to produce sub-pixel addresses and pixel addresses de- 
fining the pixel and the location within that pixel in the second two-dimensional plane in which each quadrilateral 
30 address falls as well as bank-set selection signals defining a set of pixels in the second two-dimensional plane 

that surround the origin; 

generating weighting coefficients indicative of an area of the quadrilateral from the first two-dimensional plane 
that is within each pixel of the set in the second two-dimensional plane surrounding the origin within which a 
portion of the quadrilateral exists, the weighting coefficients being generated from the bank-set selection sig- 
55 nals and the sub-pixel addresses; 

using the generated weighting coefficients and the pixel addresses to produce video data and video addresses 
in the second two-dimensional plane; 

organising the video data and video addresses in the second two-dimensional plane to produce the video 
image in the second two-dimensional plane, and 
40 outputting the video image in the second two-dimensional plane as a function of the video data and video 

addresses. 

2. A method according to claim 1 wherein the generating weighting coefficient step comprises: 

4$ determining (114, 119) which of a plurality of geometric cases pertains from a relationship between the sub- 

pixel addresses and bank-set selection signals; 

switching (113) the sub-pixel addresses to appropriate inputs of a ratio ascertaining means based on the 
determined case; 

ascertaining (115-118) secondary triangle ratios from switched sub-pixel addresses; 
so calculating (100-111 ) primary triangle areas ABO, BDO, DCO and CAO from the sub-pixel addresses; 

multiplying (120-123) the primary triangle areas by the secondary triangle ratios according to the determined 
case (114,112) to obtain secondary triangle areas; and 

combining (124-134) primary triangle areas with secondary triangle areas according to the determined case 
to obtain coefficients indicative of the area of a quadrilateral that is within each of a plurality of banks. 

55 

3. A method according to claim 1 wherein the using step comprises the steps of: 

multiplying (200) video data by an associated generated coefficient to produce a weighted video data element; 
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identifying (222) same pixels from the pixel addresses to produce a same pixel signal; 

accumulating (204,206) weighted video data elements associated with the same output pixel into a running 

total based on the same pixel signal; 

determining (218) when there is no additional data associated with an output pixel; and 
5 outputting (241 ) a video address (236) in the second two-dimensional plane and associated video data (216) 

from the running total when it is determined that there is no additional data associated with that output pixel. 

4. A method according to claim 3 wherein the step of identifying same pixels comprises the steps of: 

io latching (220) a previous address; and 

comparing (222) the previous address with a current address to produce a same pixel signal when the previous 
address and the current address are equal. 

5. A method according to claim 3 wherein the accumulating step comprises the steps of: 

is 

summing (204) weighted video data elements associated with the same pixel together into a line running total 
(206) according to the same pixel signal (222); 

storing the line running total (208) ( an associated pixel address (228), and a count (230) representing how 
many quadrilaterals on the present line contributed to the line running total; and 
20 recalling (250,210) the line running total from a previous line (212,214,216) when a line running total on a 

present line (206) should include a line running total on a previous line in order to produce a complete line 
running total. 

6. A method according to claim 5 wherein the step of recalling the line running total comprises the steps of: 

25 

reading out (268) the stored line running total (208) and associated pixel address (228) and the count (230) 
while at a location on the current line corresponding to a location of the stored line running total on the previous 
line; 

ascertaining (238,240,242) from the read out contents whether any of the associated pixel addresses from 
30 the previous line are the same as the present address on the current line; 

presenting (210,250) the line running total associated with the associated pixel address for summation (204) 
when one of the associated pixel addresses is the same (232, 234, 236) as the present address on the current 
line; and 

counting down (260) from the count to keep the location on the current line synchronised with the previous 
35 line so that corresponding locations can be known. 

7. A method according to claim 6 wherein the ascertaining step comprises the steps of: 

latching (232, 234, 236) read out contents; and 
40 comparing (238, 240, 242) the address portion of the read out contents with the present address on the current 

line and producing an equivalence indication when they are equal. 

8. A method according to claim 1 or 3 wherein pixel addresses include a side indication (202). 

45 9. a method according to claim 5 wherein pixel addresses include a side indication (202). 

10. A system for mapping a video image having a plurality of fields in a first two-dimensional plane into a video image 
having a plurality of pixels in a second two-dimensional plane according to an arbitrary mapping function, each 
pixel being defined as a quadrilateral about the pixel location, the system comprising: 



so 



means for mapping addresses (10) for the corners of the quadrilaterals defining the pixels of the video image 
in the first two-dimensional plane into the second two-dimensional plane to produce quadrilateral addresses; 
means for translating (12) an origin for the quadrilateral addresses to produce sub-pixel addresses and pixel 
addresses defining the pixel and the location within that pixel in the second two-dimensional plane in which 
each quadrilateral address falls as well as bank-set selection signals defining a set of pixels in the second 
two-dimensional plane that surrounds the origin; 

means for generating (14) waiting coefficients indicative of an area of the quadrilateral from the first two- 
dimensional plane that is within each pixel of the set in the second two-dimensional plane surrounding the 
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origin within which a portion of the quadrilateral exists, the weighting coefficients being generated from the 
back-set selection signals and the sub-pbcel addresses; 

means for using (16) the generated waiting coefficients and the pixel addresses to produce video data and 
video addresses in the second two-dimensional plane; 
5 means for organising (18, 20) the video data and video addresses in the second two-dimensional plane to 

produce the video image in the second two-dimensional plane; and 

means for outputting the video image in the second two-dimensional plane as a function of the video data and 
video addresses. 

io 11. A system according to claim 10 wherein the means for generating weighting coefficients comprises: 

means for determining (114, 119) which of a plurality of geometric cases pertains from a relationship between 
the sub-pixel addresses and bank-set selection signals; 

ratio ascertaining means (115-118) for ascertaining secondary triangle ratios from switched sub-pixel address- 
es; 

means for switching (113) the sub-pixel addresses to appropriate inputs of the ratio ascertaining means 
(115-118) based on the determined case (114); 

means for calculating (100-111 ) primary triangle areas ABO, BDO, DCO and CAO from the sub-pixel address- 
es; 

means for multiplying (120-123) the primary triangle areas by the secondary triangle ratios according to the 
determined case (114, 112) to obtain secondary triangle areas; and 

means for combining (124-134) primary triangle areas with secondary triangle areas according to the deter- 
mined case to obtain coefficients indicative of the area of a quadrilateral that is within each of a plurality of 
banks. 

12. A system according to claim 10 wherein the means for using comprises: 

means for multiplying (200) video data by an associated generated coefficient to produce a weighted video 
data element; 

means for identifying (222) same pixels from the pixel addresses to produce a same pixel signal when a current 
pixel has the same address as a previous pixel; 

means for accumulating (204,206) weighted video data elements associated with the same output pixel into 
a running total based on the same pixel signal; 

means for determining (218) when there is no additional data associated with a pixel; and 
means for outputting (241) a video address (236) in the second two-dimensional plane and associated video 
data (216) from the running total when it is determined that there is no additional data associated with a pixel. 

13. A system according to claim 12 wherein the means for identifying same pixels comprises: 

40 means for latching (220) a previous address; and 

means for comparing (222) the previous address with a current address to produce a same pixel signal when 
the previous address and the current address are equal. 

14. A system according to claim 1 2 wherein the means for accumulating comprises: 

means for summing (204) weighted video data elements associated with the same pixel together into a line 
running total (206) according to the same pixel signal (222); 

means for storing the line running total (208), an associated pixel address (228), and a count (230) representing 
how many quadrilaterals on the present line contributed to the line running total; and 

means for recalling (250,210) the line running total from a previous line (212,214,216) when a line running 
total on a present line (206) should include a line running total on a previous line in order to produce a complete 
line running total. 

15. A system according to claim 14 wherein the means for recalling the line running total comprises: 

55 

means for reading out (268) the stored line running total (208) and associated pixel address (228) and the 
count (230) while at a location on the current line corresponding to a location of the stored line running total 
on the previous line; 



30 
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means for ascertaining (238,240,242) from the read out contents whether any of the associated pixel address- 
es from the previous line are the same as the present address on the current line; 

means for presenting (210,250) the line running total associated with the associated pixel address for sum- 
mation (204) when one of the associated pixel addresses is the same (232,234,236) as the present address 
on the current line; and 

means for counting down (260) from the count to keep the location on the current line synchronised with the 
previous line so that corresponding locations can be known. 

16. A system according to claim 15 wherein the means for ascertaining comprises: 

means for latching (232, 234, 236) read out contents; and 

means for comparing (238, 240, 242) the address portion of the read out contents with the present address 
on the current line and producing an equivalence indication when they are equal. 

17. A system according to claim 10 or 12 wherein pixel addresses include a side indication (202). 

18. A system according to claim 14 wherein pixel addresses include a side indication (202). 



Patentanspruche 

1. Verfahren zur Abbildung eines Videobilds mit einer Mehrzahl von Bildelementen in einer ersten zweidimensionalen 
Ebene in ein Videobild mit einer Mehrzahl von Bildelementen in einer zwerten zweidimensionalen Ebene gemaB 
einer willkurlichen Abbildungsfunktion, wobei jedes Bildelement als Vlereck urn die Bildelementposition definiert 
ist, wobei das Verfahren die folgenden Schritte umfaftt: 

Abbildung von Adressen fur die Ecken der Vierecke, welche die Bildelemente des Videobilds in der ersten 
zweidimensionalen Ebene definieren, in die zweite zweidimensionale Ebene, urn Viereckadressen zu erzeu- 
gen; 

Ubersetzen eines Ursprungs fur die Viereckadressen zur Erzeugung von Hilfsbildelementadressen und Bild- 
elementadressen, welche das Bildelement und die Position in dem Bildelement in der zweiten zweidimensio- 
nalen Ebene definieren, in der jede Viereckadresse liegt, sowie in Reihen festgelegte Auswahlsignale, welche 
eine Bildelementreihe in der zweiten zweidimensionalen Ebene definieren, die den Ursprung umgeben; 
Erzeugen von Gewichtungskoeffizienten, die eine Flache des Vierecks aus der ersten zweidimensionalen 
Ebene anzeigen, die sich in jedem Bildelement der Reihe in der zwerten zweidimensionalen Ebene befindet, 
die den Ursprung umgibt, in der ein Abschnitt des Vierecks vorhanden ist, wobei die Gewichtungskoeffizienten 
aus den in Reihen festgelegten Auswahlsignalen und den Hilfsbildelementadressen erzeugt werden; 
Verwenden der erzeugten Gewichtungskoeffizienten und der Bildelementadressen fur die Erzeugung von Vi- 
deodaten und Videoadressen in der zweiten zweidimensionalen Ebene; 

Organisieren der Videodaten und der Videoadressen in der zweiten zweidimensionalen Ebene zur Erzeugung 
des Videobilds in der zweiten zweidimensionalen Ebene; und 

Ausgabe des Videobilds in der zweiten zweidimensionalen Ebene als eine Funktion der Videodaten und der 
Videoadressen. 



!. Verfahren nach Anspruch 1. wobei der Schritt der Erzeugung von Gewichtungskoeffizienten folgendes umfaOt: 

Ermittlung (114, 119), welcher einer Mehrzahl geometrischer Falle sich aus einem Verhaltnis der Hilfsbildele- 
mentadressen und der in Reihen festgelegten Auswahlsignale ergibt; 

Wechseln (113) der Hilfsbildelementadressen in entsprechende Eingaben einer Vemaltnisbestimmungsein- 
richtung auf der Basis des ermittelten Falls; 

Ermittlung (115-118) sekundarer Dreiecksverhaltnisse aus den gewechselten Hilfsbildelementadressen* 
Berechnung (100-111 ) primarer Dreiecks flachen ABO, BDO, DCO und CAO aus den Hilfsbildelementadres- 
sen; 

Multiptikation (120-123) der primaren Dreiecksflachen mit den sekundaren Dreiecksverhaltnissen gemaB dem 
ermittelten Fall (114, 112) zur Ermittlung der sekundaren Dreiecksflachen; und 

Verknupfung (124-134) der primaren Dreiecksflachen mit sekundaren Dreiecks flachen gemaB dem vorbe- 
stimmten Fall zur Ermittlung von Koeffizienten. die die Flache eines Vierecks anzeigen, das sich innerhaib 
jeder einer Mehrzahl von Reihen befindet. 
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Verfahren nach Anspruch 1. wobei der Schritt der Verwendung folgende Schritte umfaBt: 

Multiplikation (200) der Videodaten mrt einem zugeordneten erzeugten Koeffizienten, urn ein gewichtetes Vi- 
deodat en element zu erzeugen; 

Identifizierung (222) gleicher Bildelemente aus den Bildelementadressen zur Erzeugung eines Bildelement- 
Obereinstimmungssignals; 

Sammeln (204, 206) gewichteter Videodatenelemente, diB dem gleichen Ausgabebildelement zugeordnet 
sind, zu einem laufenden Gesamtwert auf der Basis des Bildelemenlubereinstimmungssignals; 
Ermittlung (218), wenn einem Ausgabebildelement keine zusatzlichen Daten zugeordnet sind; und 
Ausgabe (241) einer Videoadresse (236) in der zweiten zweidimensionalen Ebene und zugeordneter Video- 
daten (216) aus dem laufenden Gesamtwert, wenn festgesteltt worden ist, daB diesem Ausgabebildelement 
keine weiteren Daten zugeordnet sind. 

Verfahren nach Anspruch 3, wobei der Schritt der Identifizierung gleicher Bildelemente folgende Schritte umfaBt: 
Speichem (220) einer fruheren Adresse; und 

Vergleichen (222) der fruheren Adresse mit einer aktuellen Adresse, um das Bildelementubereinstimmungs- 
signal zu erzeugen, wenn die fruhere Adresse und die aktuelle Adresse identisch sind. 

Verfahren nach Anspruch 3, wobei der Schritt des Sammelns die folgenden Schritte umfaBt: 

Summteren (204) der gewichteten Videodatenelemente. die dem gleichen Bildelement zugeordnet sind, zu 
einem laufenden Zeilengesamtwert (206) gemaB dem Bildelementubereinstimmungssignal (222); 
Speichem des laufenden Zeilengesamtwerts (208), einer zugeordneten Bildelementadresse (228) und eines 
Zahlwerts (230), der darstellt, wie viele Vierecke auf der vorliegenden Zeile zu dem laufenden Zeilengesamt- 
wert beigetragen haben; und 

Abrufen (250, 210) des laufenden Zeilengesamtwerts einer vorhergehenden Zeile (212, 214, 216), wenn ein 
laufender Zeilengesamtwert auf einer aktuellen bzw. vorliegenden Zeile (206) einen laufenden Zeilengesamt- 
wert auf einer vorhergehenden Zeile umfassen soli, um einen kompletten laufenden Zeilengesamtwert zu 
erzeugen. 

Verfahren nach Anspruch 5, wobei der Schritt des Abrufens des laufenden Zeilengesamtwerts die folgenden Schrit- 
te umfaBt: 

Auslesen (268) des gespeicherten laufenden Zeilengesamtwerts (208) und der zugeordneten Bildelement- 
adresse (228) sowie des Zahlwerts (230) an einer Steile auf der aktuellen Zeile, die einer Stelle des gespei- 
cherten laufenden Zeilengesamtwerts auf der vorhergehenden Zeile entspricht; 

Feststellen (238, 240, 242) aus dem Ausleseinhatt, ob etwaige zugeordnete Bildelementadressen der vorher- 
gehenden Zeile mit der aktuellen Adresse auf der aktuellen Zeile ubereinstimmen; 

Presentation (210, 250) des der zugeordneten Bildelementadresse zugeordneten laufenden Zeilengesamt- 
werts zur Summierung (204), wenn eine der zugeordneten Bildelementadressen mrt der vorliegenden Adresse 
auf der aktuellen Zeile Obereinstimmt (232, 234, 236); und 

Herunterzahlen (260) von dem Zahlwert, um die Stelle bzw. die Position auf der aktuellen Zeile synchron zu 
der vorhergehenden Zeile zu halten, so daB die entsprechenden Stellen festgesteltt werden konnen. 

Verfahren nach Anspruch 6, wobei der Schritt des Feststellens folgende Schritte umfafit: 

Speichem (232, 234, 236) des Ausleseinhalts; und 

Vergleichen (238, 240, 242) des AdreBabschnitts des Ausleseinhalts mit der vorliegenden Adresse auf der 
aktuellen Zeile, und wobei eine Equivalenzanzeige erzeugt wird, wenn die beiden Werte ubereinstimmen. 

Verfahren nach Anspruch 1 oder 3, wobei die Bildelementadressen eine Seitenanzeige (202) aufweisen. 

Verfahren nach Anspruch 5, wobei die Bildelementadressen eine Seitenanzeige (202) aufweisen. 

System zur Abbildung eines Videobilds mit einer Mehrzahl von Tetlbildern in einer ersten zweidimensionalen Ebene 
in ein Videobild mit einer Mehrzahl von Bildelementen in einer zweiten zweidimensionalen Ebene gemaB einer 
willkurlichen Abbildungsfunktion, wobei jedes Bildelement als ein Viereck um die Bildelementposition definiert ist; 
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wobei das System folgendes umfa&t: 

etne Einrichtung zur Abbildung von Adressen (10) fur die Ecken der Vierecke, welche die Bildelemente des 
Videobilds in der ersten zweidimensionalen Ebene definieren, in die zweite zweidimensionale Ebene, um 

s Viereckadressen zu erzeugen; 

eine Einrichtung zum Ubersetzen (12) eines Ursprungs fur die Viereckadressen zur Erzeugung von Hilfsbild- 
elementadressen und Bildelementadressen, welche das Bildelement und die Position in dem Bildelement in 
der zweiten zweidimensionalen Ebene definieren, in der jede Viereckadresse liegt, sowie in Reihen testgelegte 
Auswahlsignale, welche eine Bildelementreihe in der zweiten zweidimensionalen Ebene definieren, die den 

io Ursprung umgeben; 

eine Einrichtung zum Erzeugen (14) von Gewichtungskoeffizienten, die eine Flache des Vierecks aus der 
ersten zweidimensionalen Ebene anzeigen, die sich jedem Bildelement der Reihe in der zweiten zweidimen- 
sionalen Ebene befindet, die den Ursprung umgibt, in der ein Abschnitt des Vierecks vorhanden ist, wobei die 
Gewichtungskoeffizienten aus den in Reihen festgelegten Auswahlsignalen und den Hilfsbildelementadressen 

^5 erzeugt werden; 

eine Einrichtung zur Verwendung (16) der erzeugten Gewichtungskoeffizienten und der Bildelementadressen 
fur die Erzeugung von Videodaten und Videoadressen in der zweiten zweidimensionalen Ebene; 
eine Einrichtung zum Organisieren (18, 20) der Videodaten und der Videoadressen in der zweiten zweidimen- 
sionalen Ebene zur Erzeugung des Videobilds in der zweiten zweidimensionalen Ebene; und 

20 eine Einrichtung zur Ausgabe des Videobilds in der zweiten zweidimensionalen Ebene als eine Funktion der 

Videodaten und der Videoadressen. 

1 1 . System nach Anspruch 1 0, wobei die Einrichtung zur Erzeugung von Gewichtungskoeffizienten folgendes umfaBt: 

2S ein Einrichtung zur Ermittlung (114, 119), welcher einer Mehrzahl geometrischer Falle sich aus einem Verhalt- 

nis der Hilfsbildelementadressen und der in Reihen festgelegten Auswahlsignale ergibt; 
eine Verhaltnisbestimmungseinrichtung (115-118) zur Bestimmung sekundarer Dreiecksverhaltnisse aus ge- 
wechselten Hilfsbildelementadressen; 

eine Einrichtung zum Wechseln (113) der Hilfsbildelementadressen in entsprechende Eingaben der Verhaft- 
30 nisbestimmungseinrichtung (115-118) auf der Basis des ermittelten Falls; 

eine Einrichtung zur Berechnung (100-111) primarer Dreiecks flachen ABO, BDO, DCO und CAO aus den 
Hilfsbildelementadressen; 

eine Einrichtung zur Multiplikation (120-123) der primaren Dreiecks flachen mit den sekundaren Dreiecksver- 
haltnissen gemaB dem ermittelten Fall (114, 112) zur Ermittlung der sekundaren Dreiecks flachen; und 
3S eine Einrichtung zur Verknupfung (124-1 34) der primaren Dreiecks flachen mit sekundaren Dreiecks flachen 

gemaR dem vorbestimmten Fall zur Ermittlung von Koeffizienten, die die Flache eines Vierecks anzeigen, das 
sich innerhalb jeder einer Mehrzahl von Reihen befindet. 

12. System nach Anspruch 10, wobei die Einrichtung zur Verwendung folgendes umfalM : 

40 

eine Einrichtung zur Multiplikation (200) der Videodaten mit einem zugeordneten erzeugten Koeffizienten, um 
ein gewichtetes Videodatenelement zu erzeugen; 

eine Einrichtung zur Identifizierung (222) gleicher Bildelemente aus den Bildelementadressen zur Erzeugung 
eines Bildelementubereinstimmungssignals; 
4 $ eine Einrichtung zum Sammeln (204, 206) gewichteter Videodatenelemente, die dem gleichen Ausgabebild- 

element zugeordnet sind, zu einem laufenden Gesamtwert auf der Basis des Bildelementubereinstimmungs- 
signals; 

eine Einrichtung zur Ermittlung (218), wenn einem Ausgabebildelement keine zusatzlichen Daten zugeordnet 
sind; und 

50 eine Einrichtung zur Ausgabe (241) einer Videoadresse (236) in der zweiten zweidimensionalen Ebene und 

zugeordneter Videodaten (216) aus dem laufenden Gesamtwert, wenn festgestellt worden ist, dafj diesem 
Ausgabebildelement keine weiteren Daten zugeordnet sind. 

13. System nach Anspruch 12, wobei die Einrichtung zur Identifizierung gleicher Bildelemente folgendes umfafM: 

55 

eine Einrichtung zum Speichern (220) einer fruheren Adresse; und 

eine Einrichtung zum Vergleichen (222) der fruheren Adresse mit einer aktuellen Adresse, um das Bildele- 
mentubereinstimmungssignal zu erzeugen, wenn die fruhere Adresse und die aktuelle Adresse identisch sind. 
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14. System nach Anspruch 12, wobei die Einrichtung zum Sammeln folgendes umfaGt: 

eine Einrichtung zum Summieren (204) der gewichteten Videodatenelemente, die dem gleichen Bildelement 
zugeordnet sind. zu einem laufenden Zeilengesamtwert (206) gemaG dem Bildelementubereinstimmungs- 
5 signal (222); 

eine Einrichtung zum Speichern des laufenden Zeilengesamtwerts (208), einer zugeordneten Bildelement- 
adresse (228) und eines Zahlwerts (230), der darstellt, wie viele Vierecke auf der vorliegenden Zeile zu dem 
laufenden Zeilengesamtwert beigetragen haben; und 

eine Einrichtung zum Abrufen (250, 210) des laufenden Zeilengesamtwerts einer vorhergehenden Zeile (212, 
10 214, 216), wenn ein laufender Zeilengesamtwert auf einer aktuellen bzw. vorliegenden Zeile (206) einen lau- 

fenden Zeilengesamtwert auf einer vorhergehenden Zeile umfassen soli, um einen kompletten laufenden Zei- 
lengesamtwert zu erzeugen. 

15. System nach Anspruch 14, wobei die Einrichtung zum Abrufen des laufenden Zeilengesamtwerts folgendes um- 
is faBt: 

eine Einrichtung zum Auslesen (268) des gespeicherten laufenden Zeilengesamtwerts (208) und der zuge- 
ordneten Bildelementadresse (228) sowie des Zahlwerts (230) an einer Stelle auf der aktuellen Zeile, die einer 
Stelle des gespeicherten laufenden Zeilengesamtwerts auf der vorhergehenden Zeile entspricht; 

20 eine Einrichtung zum Feststellen (238, 240, 242) aus dem Ausleseinhalt, ob etwaige zugeordnete Bildele- 

mentadressen der vorhergehenden Zeile mit der aktuellen Adresse auf der aktuellen Zeile Obereinstimmen; 
eine Einrichtung zur Presentation (210, 250) des der zugeordneten Bildelementadresse zugeordneten laufen- 
den Zeilengesamtwerts zur Summierung (204), wenn eine der zugeordneten Bildelementadressen mit der 
vorliegenden Adresse auf der aktuellen Zeile ubereinstimmt (232, 234, 236); und 

25 eine Einrichtung zum Herunterzahlen (260) von dem Zahlwert, um die Stelle bzw. die Position auf der aktuellen 

Zeile synchron zu der vorhergehenden Zeile zu halten, so daB die entsprechenden Stellen festgestellt werden 
konnen. 

16. System nach Anspruch 15, wobei die Einrichtung zum Feststellen folgendes umfaBt: 

30 

eine Einrichtung zum Speichern (232, 234, 236) des Ausleseinhalts; und 

eine Einrichtung zum Vergleichen (238, 240, 242) des AdreBabschnitts des Ausleseinhalts mit der vorliegen- 
den Adresse auf der aktuellen Zeile, und wobei eine Equivalenzanzeige erzeugt wird, wenn die beiden Werte 
Obereinstimmen. 

35 

17. System nach Anspruch 10 oder 12, wobei die Bildelementadressen eine Seitenanzeige (202) aufweisen. 

18. System nach Anspruch 14 : wobei die Bildelementadressen eine Seitenanzeige (202) aufweisen. 

40 

Revendications 

1. Procede pour representer en une image video comportant une pluratite de pixels, dans un second plan a deux 
dimensions, suivant une fonction de projection arbitraire une image video comportant une pluralite de pixels dans 
45 un premier plan a deux dimensions, chaque pixel etant determine en tant qu'un quadrilatere autour de I'emplace- 

ment de pixel, le procede comprenant les stapes de : 

representer dans le second plan a deux dimensions, pour produire des adresses de quadrilatere, des adresses 
pour les coins des quadrilateres qui determinent les pixels de Pimage video dans le premier plan a deux 
50 dimensions, 

deplacer une origine pour les adresses de quadrilateres afin de produire de produire des adresses de pixels 
secondares et des adresses de pixels qui d61erminent le pixel et Pemplacement dans ce pixel, dans le second 
plan a deux dimensions dans lequel chaque adresse de quadrilatere tombe, ainsi que des signaux de selection 
d'ensembles de groupes qui d6terminent dans le second plan a deux dimensions, un ensemble de pixels qui 
55 entourent I'origine, 

produire des coefficients de pond6ration indicateurs d'une surface du quadrilatere, en provenance du premier 
plan a deux dimensions, qui est, dans le second plan a deux dimensions, dans chaque pixel, de ('ensemble 
entourant I'origine, dans lequel il y a une partie du quadrilatere, les coefficients de pond6ration 6tant produits 
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a partir des signaux de selection d'ensemble de groupes e1 des adresses de pixels secondares, 

utiliser les coefficients de ponderation produits et les adresses de pixels pour produire dans le second plan a 

deux dimensions des donnees video et des adresses video, 

organiser dans le second plan a deux dimensions les donnees video et les adresses video pour produire 
I'image video dans le second plan a deux dimensions, et 

delivrer I'image video dans le second plan a deux dimensions en tant qu'une fonction des donnees video et 
des adresses video. 

Procede suivant la revendication 1, caracterise en ce que I'etape de production de coefficients de ponderation 
comprend celles de : 

determiner (114, 119) lequel d'une plurality de cas g6om6triques appartient a uno relation entre les adresses 
de pixels secondaires et les signaux de selection d'ensemble de groupes, 

commuter (1 1 3), sur base du cas determine, les adresses de pixels secondaires vers des entrees appropriees 
d'un moyen de verification de rapport, 

verifier (115-118) des rapports de triangles secondaires a partir cTadresses de pixels secondaires commutes, 
calculer (100- 111) des surfaces de triangles primaires ABO, BDO, DCO et CAO a partir des adresses de 
pixels secondaires, 

multiplier (120 - 123} les surfaces de triangles primaires par les rapports de triangles secondaires suivant le 
cas determine (114, 112) pour obtenir des surfaces de triangles secondaires, et 

combiner (124-1 34) des surfaces de triangles primaires et des surfaces de triangles secondaires suivant le 
cas determine, pour obtenir des coefficients indicateurs de la surface d'un quadrilatere qui est dans chacun 
de la pluralite des groupes. 

Procede suivant la revendication 1, caracterise en ce que I'etape d'utilisation comprend les etapes de : 

multiplier (200) des donnees video par un coefficient produit associe, pour produire un element de donnees 
video pond6r6, 

identifier (222) des memes pixels a partir des adresses de pixels, pour produire un signal de meme pixel, 
accumuler (204, 206) des elements de donnees video ponderes, associes au meme pixel de sortie, en un 
total cumuli base sur le signal de meme pixel, 

determiner (218) quand il n'y a pas de donn6es supplementaires associ6es a un pixel de sortie, et 
delivrer (241 ) une adresse video (236) dans le second plan a deux dimensions et des donnees video associees 
(216) en provenance du total cumule, lorsqu'il est determine qu'il n'y a pas de donnees supplementaires as- 
sociees a ce pixel de sortie. 

Procede suivant la revendication 3 : caracterise en ce que I'etape d'identifier des memes pixels comprend les 
etapes de : 

bloquer (220) une adresse precedente, et 

comparer (222) I'adresse precedente et une adresse courante pour produire un signal de mdme pixel, lorsque 
I'adresse precedente et I'adresse courante sont egales. 

Procede suivant la revendication 3, caracterise en ce que I'etape d'accumulation comprend les etapes de : 

additionner (204) ensemble en un total cumule de ligne (206), suivant le signal de meme pixel (222). des 
elements de donnees video pond6res associes au m&me pixel, 

memoriser le total cumuie de ligne (208), une adresse de pixel associee (228) et un compte (230) representant 
combien de quadrilateres, sur la presente ligne, ont contribues au total cumule de ligne, et 
rappeler (250, 210) le total cumule de ligne d'une ligne precedente (212, 214, 216) lorsqu'un total cumule de 
ligne, sur ta presente ligne (206), devrait comprendre un total cumule de ligne sur une ligne precedente afin 
de produire un total cumuie de ligne complet. 

Procede suivant la revendication 5, caracterise en ce que i'etape de rappel du total cumule de ligne comprend les 
etapes de : 

lire (268) le total cumule de ligne memorise (208) et I'adresse de pixel associe (228) et le temps de compte 
(230) en un emplacement sur la ligne courante correspondant a un emplacement du total cumuie de ligne 
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memorise, sur la ligne precedente, 

verifier (238, 240, 242), a partir des contenus fus, si quelques unes des adresses de pixels associes en pro- 
venance de la ligne pr6cedente sont les memes que I'adresse presente sur la ligne courante, 
presenter (210, 250) le total cumule de ligne, associe a I'adresse de pixel associe, en vue d'une addition (204) 
s lorsque I'une des adresses de pixels associes est la meme (232, 234, 236) que la presente adresse sur la 

ligne courante, et 

decompter (260) a partir du compte pour conserver ['emplacement sur la ligne courante synchronise avec 
celui de la ligne precedente de facon a ce que des emplacements correspondents putssent etre connus. 

io 7. Procede suivant la revendication 6, caracterise en ce que I'etape de verification comprend les etapes de : 

bloquer (232, 234, 236) des contenus lus, et 

comparer (238, 240, 242) la partie cfadresse des contenus lus et la presente adresse sur la ligne courante et 
produire une indication d'equivalence lorsqu'elles sont egales. 

15 

8. Procede suivant la revendication 1 ou 3, caracterise en ce que des adresses de pixels comprennent une indication 
de cote (202). 

9. Procede suivant la revendication 5, caracterise en ce que des adresses de pixels comprennent une indication de 
20 cote (202). 



10. Systems pour representer une image video comportant une pluralite de trames, dans un premier plan a deux 
dimensions, en une image video comportant une pluralite de pixels dans un second plan a deux dimensions, 
suivant une fonction de representation arbitrage, chaque pixel 6tant determine en tant qu'un quadrilatere autour 

25 de ('emplacement de pixel, le systeme comprenant : 

des moyens pour representer dans le deuxieme plan a deux dimensions des adresses (10) pour les coins des 
quadrilateres determinant les pixels de I'image video du premier plan a deux dimensions afin de produire des 
adresses de quadrilatere, 

30 - des moyens pour deplacer (12) une origine pour les adresses de quadrilatere afin de produire des adresses 

de pixels secondaires et des adresses de pixels determinant le pixel et ('emplacement dans ce pixel, dans le 
second plan a deux dimensions, dans lequel chaque adresse de quadrilatere tombe, aussi bien que des si- 
gnauxde selection d'ensemble de groupes determinant, dans le second plan a deux dimensions, un ensemble 
de pixels qui entourent I'origine, 

35 - des moyens pour produire (14) des coefficients de ponderation indiquant une surface du quadrilatere, en 

provenance du premier plan a deux dimensions, qui est, dans le second plan a deux dimensions, dans chaque 
pixel, de I'ensemble entourant I'origine, dans lequel il y a une partie du quadrilatere, les coefficients de pon- 
deration etant produits a partir des signaux de selection d'ensemble de groupes et des adresses de pixels 
secondaires, 

40 - des moyens pour utiliser (16) les coefficients de ponderation produits et les adresses de pixels afin de produire 

des donnees video et des adresses video dans le second plan a deux dimensions, 

des moyens pour organiser (18, 20) les donnees video et les adresses video dans le second plan a deux 
dimensions afin de produire I'image video dans le second plan a deux dimensions, et 

des moyens pour delivrer I'image video dans le second plan a deux dimensions en tant que fonction des 
45 donnees video et adresses video. 

11. Systeme suivant la revendication 10, caracterise en ce que les moyens pour produire des coefficients de ponde- 
ration comprennent : 

so - des moyens pour determiner (114, 119) lequel d'une pluralite de cas geometriques appartient a la relation 

entre les adresses de pixels secondaires et les signaux de selection d'ensemble de groupes, 
des moyens de verification de rapport (115-118) pour verifier des rapports de triangles secondaires a partir 
d'adresses de pixels secondaires commutes, 

des moyens pour commuter (113) les adresses de pixels secondaires vers des entrees appropriees des 
ss moyens de verification de rapport (115 - 118) sur base du cas determine (114), 

des moyens pour calculer (100 - 111) des surfaces de triangles primaires ABO, BDO, DCO et CAO a partir 
des adresses de pixels secondaires, 

des moyens pour multiplier (120 - 123) les surfaces de triangles primaires par les rapports de triangles se- 
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condaires suivant le cas d6termin6 (114, 112), pour obtenir des surfaces de triangles secondares, et 
des moyens pour combiner (124 - 134) des surfaces de triangles primaires et des surfaces de triangles se- 
condares suivant le cas d6termine\ pour obtenir des coefficients indiquant la surface d'un quadrilatere qui est 
dans chacun d'une pluralite de groupes. 

12. Systeme suivant la revendication 10, caracterise en ce que les moyens pour utiliser comprennent: 

des moyens pour multiplier (200) des donnees video par un coefficient produit associe.. afin de produire un 
element de donnees video pondere, 

des moyens pour identifier (222) des memes pixels a partir des adresses de pixels, afin de produire un signal 
de meme pixel lorsqu'un pixel courant a la meme adresse qu'un pixel pr6c6dent, 

des moyens pour accumuler (204, 206) des elements de donnees video ponderes, associes au meme pixel 
de sortie, dans un total cumule, sur base du signal de meme pixel, 

des moyens pour determiner (218) lorsqu'il n*y a pas de donn6es suppl6mentaires assoctees a un pixel, et 
des moyens pour delivrer (241) une adresse video (236) dans le second plan a deux dimensions et des don- 
nees video associ6es (216) a partir du total cumule\ lorsqu'il est determine qu'il n'y a pas de donnees suppl6- 
mentaires associees a un pixel. 

13. Systeme suivant la revendication 12, caracterise en ce que les moyens pour identifier des memes pixels 
comprennent : 

des moyens pour bloquer (220) une adresse precedente, et 

des moyens pour comparer (222) I'adresse pr6c6dente et une adresse courante, afin de produire un signal 
de meme pixel lorsque Padresse precedente et I'adresse courante sont egales. 

14. Systeme suivant la revendication 12, caracterise en ce que les moyens pour accumuler comprennent : 

des moyens pour additionner (204) ensemble, en un total cumule de ligne (210) suivant le signal de meme 
pixel (222), des 6l6ments de donn6es vid6o ponders associes au m6me pixel, 

des moyens pour memoriser le total cumule de ligne (208), une adresse de pixel associe (228) et un compte 
(230) representant combien de quadrilateres, sur la presente ligne, ont contribue au total cumule de ligne, et 
des moyens pour rappeler (250, 210) le total cumule de ligne, a partir d'une ligne precedente (212, 214 : 216), 
lorsqu'un total cumule de ligne, sur une presente ligne (206), devrait comprendre un total cumul§ de ligne sur 
une ligne precedente, afin de produire un total cumule de ligne complet. 

15. Systeme suivant la revendication 14, caracterisS en ce que les moyens pour rappeler le total cumule de ligne 
comprennent : 

des moyens pour lire (268) le total cumule de ligne (208) memorise et une adresse de pixel associe (228) et 
le temps de compte (230) a un emplacement sur la ligne courante correspondant a un emplacement du total 
cumule de ligne memorise, sur la ligne precedente, 

des moyens pour verifier (238, 240, 242) a partir des contenus lus si quelques unes des adresses de pfxefs 
associes, en provenance de la ligne precedente, sont les memes que la presente adresse de la ligne courante, 
des moyens pour presenter (210, 250) le total cumule de ligne assocte a I'adresse de pixel associe, en vue 
d'une addition (204) lorsque Tune des adresses de pixels associes est la meme (232, 234, 236) que la presente 
adresse sur la ligne courante, et 

des moyens pour decompter (260) a partir du compte afin de conserver ('emplacement sur (a ligne courante 
synchronise avec celui de la ligne precedente, de facon a ce que des emplacements correspondants puissent 
§tre connus. 

16. Systeme suivant la revendication 15, caract6rise~ en ce que les moyens de verification comprennent : 

des moyens pour bloquer (232, 234, 236) des contenus lus, et 

des moyens pour comparer (238, 240, 242) la partie d'adresse des contenus lus et la presente adresse sur 
la ligne courante et pour produire une indication d'equivalence lorsqu'elles sont 6gales. 

17. Systeme suivant la revendication 10 ou 12 caracterise en ce que des adresses de pixels comprennent une indi- 
cation de cote* (202). 
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18. Systeme suivant la revendication 14, caracterise en ce que des adresses de pixels comprennent une indication 
de cote (202). 
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